A new learning rate based on Andrei method for training feed-forward artificial neural networks
نویسندگان
چکیده
In this paper we developed a new method for computing learning rate Back-propagation algorithm to train feed-forward neural networks. Our idea is based on the approximating inverse Hessian matrix error function originally suggested by Andrie. Experimental results show that proposed considerably improve convergence of chosen test problem.
منابع مشابه
Learning in Feed-Forward Artificial Neural Networks I
The view of artificial neural networks as adaptive systems has lead to the development of ad-hoc generic procedures known as learning rules. The first of these is the Perceptron Rule (Rosenblatt, 1962), useful for single layer feed-forward networks and linearly separable problems. Its simplicity and beauty, and the existence of a convergence theorem made it a basic departure point in neural lea...
متن کاملLearning in Feed-Forward Artificial Neural Networks II
Supervised Artificial Neural Networks (ANN) are information processing systems that adapt their functionality as a result of exposure to input-output examples. To this end, there exist generic procedures and techniques, known as learning rules. The most widely used in the neural network context rely in derivative information, and are typically associated with the Multilayer Perceptron (MLP). Ot...
متن کاملTraining a Feed-forward Neural Network with Artificial Bee Colony Based Backpropagation Method
Back-propagation algorithm is one of the most widely used and popular techniques to optimize the feed forward neural network training. Nature inspired meta-heuristic algorithms also provide derivative-free solution to optimize complex problem. Artificial bee colony algorithm is a nature inspired meta-heuristic algorithm, mimicking the foraging or food source searching behaviour of bees in a bee...
متن کاملConstructing and training feed-forward neural networks for pattern classification
A new approach of constructing and training neural networks for pattern classi$cation is proposed. Data clusters are generated and trained sequentially based on distinct local subsets of the training data. Obtained clusters are then used to construct a feed-forward network, which is further trained using standard algorithms operating on the global training set. The network obtained using this a...
متن کاملUsing Hybrid Artificial Bee Colony Algorithm and Particle Swarm Optimization for Training Feed-forward Neural Networks
The Artificial Bee Colony Algorithm (ABC) is a heuristic optimization method based on the foraging behavior of honey bees. It has been confirmed that this algorithm has good ability to search for the global optimum, but it suffers from the fact that the global best solution is not directly used, but the ABC stores it at each iteration, unlike the particle swarm optimization (PSO) that can direc...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Ma?alla? Tikr?t li-l-?ul?m al-?irfa?
سال: 2023
ISSN: ['2415-1726', '1813-1662']
DOI: https://doi.org/10.25130/tjps.v22i2.635